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This paper develops a framework for analyzing and designing dynamic networks comprising dif- 
ferent classes of nodes that coexist and interact in one shared environment. We consider ad hoc 
(i.e., nodes can leave the network unannounced, and no node has any global knowledge about the 
class identities of other nodes) preferentially grown networks, where different classes of nodes are 
characterized by different sets of local parameters used in the stochastic dynamics that all nodes in 
the network execute. We show that multiple scale-free structures, one within each class of nodes, 
and with tunable power-law exponents (as determined by the sets of parameters characterizing each 
class) emerge naturally in our model. Moreover, the coexistence of the scale-free structures of the 
different classes of nodes can be captured by succinct phase diagrams, which show a rich set of 
structures, including stable regions where different classes coexist in heavy-tailed (i.e., exponent 
is between 2 and 3) and light-tailed (i.e., exponent is > 3) states, and sharp phase transitions. 
The topology of the emergent networks is also shown to display a complex structure, akin to the 
distribution of different components of an alloyed material; e.g., nodes with a light-tailed scale-free 
structure get embedded to the outside of the network, and have most of its edges connected to nodes 
belonging to the class with a heavy-tailed distribution. Finally, we show how the dynamics formu- 
lated in this paper will serve as an essential part of ad-hoc networking protocols, which can lead to 
the formation of robust and efficiently searchable networks (including, the well-known Peer-To-Peer 
(P2P) networks) even under very dynamic conditions. 
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I. INTRODUCTION 
A. Motivation 

Real networks are rarely homogeneous, and often com- 
prise different categories of constituent nodes, all of which 
interact and coexist in a single global environment. The 
classification of nodes in such networks might be based 
on different characteristics, including diverse function- 
alities, different objectives and scale of resources, and 
different types and degrees of dynamics inherent to the 
nodes. Examples include, different cell types in a neu- 
ral network, different roles in the web of English words 
(e.g., verbs, nouns, and adjectives), different disciplines 
in the network of scientific collaborations, various switch 
types (routers, hubs, etc.) in the Internet, and the dif- 
ferent node types in a Peer-to-Peer (P2P) network (e.g., 
nodes with 56K-Baud modem connections vs. nodes with 
DSL connections). Empirical evidence of class-specific 
hierarchical and scale-free structures in many complex 
networks have become available only recently Q ■ For ex- 
ample, a heterogeneous scenario has been reported in the 
network of scientific citations: While the overall structure 
of such networks is believed to have a power-law (PL) de- 
gree distribution 28] with exponent 7 « 3, the network of 
citations restricted to theoretical physicists is somewhat 
more heavy tailed with an exponent around 7 ~ 2.6 Q. 

The objective of this paper is to explore the dynamics 
of such heterogeneous networks, and study how different 
types of nodes influence each other, and when and how 
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multiple scale-free structures may emerge in the networks. 
We find that the interacting sets of different classes of 
nodes can give rise to a complex global structure, and 
display a rich set of emergent properties. In particu- 
lar, we show (i) Viewing complex systems as networks 
with different evolving, and interacting constituent sub- 
networks, helps gain better understanding about the role 
of each class of nodes in the overall network, and sheds 
light on how different networks with nested structures 
might have evolved, and (ii) How the results can lead to 
the systematic design of heterogeneous networks, where 
different categories of nodes evolve to have different scale- 
free structures (corresponding to their capabilities and 
intentions). 

B. Dynamical Model and Results 

We consider ad hoc dynamical networks, where in ad- 
dition to nodes joining the network, nodes also disconnect 
and leave the network randomly at certain rates. More- 
over, nodes are allowed to respond to their environment, 
and can initiate new random connections if their existing 
connections are lost. The dynamical rules studied in this 
paper, have been picked from those traditionally stud- 
ied in the context of complex networks. For example, 
in all the protocols studied in this paper all connections 
are initiated by choosing nodes in a linear preferential 
manner. Similarly, the other dynamics that we incorpo- 
rate are joining of new nodes, random deletion of existing 
nodes, and compensatory rewiring by existing nodes that 
might have lost an edge because of the deletion dynam- 
ics. As described next, the different classes of nodes in 
the network follow the same global dynamics, except with 
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different parameters. Additionally, to be true to the ad 
hoc nature of our model, we enforce that the class iden- 
tity of a node is not a global knowledge; instead, a node's 
identity is expressed only through its own dynamics and 
actions, i.e., in how it responds to and initiates contacts 
with other nodes in the network. Thus, a node on joining 
the network makes requests for connection without any 
global knowledge about the properties of other nodes in 
the network, and the connection requests are made fol- 
lowing the traditional preferential attachment rule. 

Modeling Heterogeneity of Nodes: The different classes 
of nodes are characterized by different sets of param- 
eters they adopt in responding to connection requests, 
and also in executing local dynamics. The most impor- 
tant local parameters used in this paper to capture het- 
erogeneity of nodes, include (i) attraction or attachment , 
i.e., a node's willingness to accept a requested connec- 
tion; this can be parametrized by the probability, d q , 
with which the nodes in the q th class accept a connec- 
tion request, (ii) stability, i.e., how long they stay in the 
network before dropping out or deleting themselves; this 
can be parametrized by the probability, c q , with which 
a randomly picked node in the q th class gets deleted at 
each time step, (hi) responsiveness, i.e., a node's ability 
to respond to lost or dead connections and compensate 
for them with new connection; this can be parametrized 
by the probability, n q with which a node in the q th class 
compensates for any lost or inactive connection, and (iv) 
representation or relative population, i.e., what percent- 
age of the nodes joining the network belong to a specific 
class; this can be parameterized by the probability, s„, 
with which a node joining the network is from the q 
class. In general, the different categories of nodes in a 
network may differ in all four of these parameters. 

C. Approach and A Preview of Results 

We are interested in finding P q (k), the degree distri- 
butions within each of the subclasses. That is, P q (k) is 
the probability of a randomly chosen node of type q to 
have degree k; note that all edges, both intra- and inter- 
community edges, contribute to the degree of a node. In 
particular, we will show the emergence of scalc-frcc de- 
gree distributions within each class, that is P q (k) oc k~ lq . 
In general, for a given set of Q classes, the PL exponent 
7 g of the q th class is a function of all the four sets of 
parameters. That is, in general we have 

lg = f(D,C,N,S) for aUg=l,...,Q, 

where D = {rfi, • • • , d Q }, C = {ci, • • • , c Q }, N = 
{ni,--- ,uq}, and S — {si, ■ ■ ■ ,sq}, are the sets of, 
attachment, stability, responsiveness, and representation 
parameters for the Q different classes of nodes. We apply 
the continuous-time rate equation approach to study the 
dynamics and derive 7 q 's. The coexistence of different 
classes of networks will impose certain constraints on the 
set of 7 9 's emerging in the subclasses, and hence, only 



certain sets of 7 g 's for a given choice of the dynamical 
parameters are feasible. 



As discussed in Section IIVI it is always possible to 
compute the 7 g 's numerically using the rate-equation ap- 
proach. An exact closed form computation of the various 
PL exponents (as a function of the different sets of pa- 
rameters), however, is difficult to obtain when the classes 
are heterogeneous with respect to all the local parameters. 
Hence, to develop intuition and to better understand the 
heterogeneous systems, we study special cases where it is 
possible to obtain exact formulas for the computation of 
7 9 's. For example, in Section lTni we study the case, where 
the sets are heterogeneous over only the sets D and S, i.e., 
the q th class has attachment rate d q and relative popula- 
tion s q . Moreover, we allow deletions of random nodes at 
an overall rate of c (i.e., the deletion rates of the q th class 
is given as c q — c* s q , and cannot be set independently) , 
and no compensation, i.e., n% = ri2 = • • • = uq = 0. Eqs. 
|5] and [3] provide the exact formula for 7 g 's for this par- 
ticular model. Interesting features include: (i) Coupled 
PL exponents: The average PL degree is constrained to 
be greater than 3. Thus for example, for Q = 2, one 
class can have PL exponent < 3, while the other one has 
to have exponent > 3. Recall that if Q = 1 and c = 0, 
it is exactly the case of linear preferential attachment, 
and the exponent is exactly equal to 3. Hence, by hav- 
ing multiple classes, one can have classes that have heavy 
tailed PL degree distributions (i.e., exponent < 3), even 
with the linear preferential attachment kernel. In gen- 
eral, for different c's the possible PL exponents (71,72) 
are plotted in Fig. [21 (ii) Role of the Deletion Rate c: If 
Q = 1 then it is shown in ^1 that for any deletion rate 
c > 0, the PL exponent is > 3, and that the exponent 
increases rapidly with an increase in c. As shown in Fig. 
121 for two classes it is possible to have one class with PL 
exponent < 3. However, there is always a deletion rate 
for which both the exponents become > 3. Thus, the 
heterogeneity of the network can lead to rich structures, 
which otherwise do not exist in homogeneous networks. 



The more general case, where we vary three sets of pa- 
rameters, C, N, S, while the attachment rates are consid- 
ered to be unity for all the classes, i.e., di = ■ ■ ■ = rfg = 1, 
is considered in Section ITV1 It is best to describe the re- 
sults in terms of a phase space, where the state of a class 
can be attributed as described in the following. Another 
means of studying the networks is to look at the embed- 
ding of the different classes of nodes in the overall struc- 
ture. Both of these macroscopic approaches and related 
results are summarized in the following. 
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Emergence and Coexistence of Phases: The degree dis- 
tribution of a particular category of node could be clas- 
sified into the following phases or states, depending on 
the exponent, 7, of its PL distribution: (i) Heavy Tailed: 
2 < 7 < 3; for such a distribution, the variance becomes 
unbounded while the mean remains bounded. It is in this 
regime that the corresponding network shows a number 
of advantageous properties, such as almost-constant di- 
ameter, efficiently searchable, and resistance to random 
deletions of nodes and edges, (ii) Light Tailed: 7 > 3, 
(iii) Unstable: < 7 < 2, this is when the average de- 
gree becomes unbounded, and (iv) Extinction: when the 
average degree goes to zero, i.e., the nodes belonging to 
this class get disconnected from the rest. Clearly, one can 
make a finer division of the range of the PL exponent and 
define a larger number of phases. 

We investigate issues related to how the different cate- 
gories of nodes can be in different phases as a function of 
the parameters of the dynamics. Also, how will a phase 
transition within one subclass (e.g., from a heavy to a 
light tailed phase) affect the phase of the other classes? 
As shown in Section [Vl we find that the rich set of so- 
lutions of the dynamical model introduced in this paper, 
can be captured by succinct phase diagrams, which show 
the coexistence of different phases of different categories 
of nodes, as a function of the parameters. The results 
show that the phase space shows all the hallmarks of a 
rich heterogeneous system, including 

• Stable regions where different categories of nodes 
can be in different desired phases (e.g., certain 
classes in the heavy-tailed phase, while certain oth- 
ers in the light tailed phase). These regions have 
sufficient volume/area so that the resulting degree- 
distributions are fairly insensitive to the exact 
choice of the different parameters; see simulation 
results in Section [V] 

• Regions in the phase space, corresponding to ex- 
haustive combinations of phases that the different 
classes of nodes can exist, emerge quite naturally. 
For example, Figs. and 0] show that all four pos- 
sible combinations of light and heavy tailed phases 
of two categories of nodes are possible. 

• The parameter space has boundaries showing sharp 
phase transitions. This can allow abrupt transfor- 
mations and manipulations of underlying network 
topology by changing the dynamical parameters 
only marginally. 

Topology of the Heterogeneous Networks: We address is- 
sues related to how the different categories of nodes get 
embedded in the network. For example, one could ask 
where in the network do nodes of different classes migrate 
to? When a particular class of nodes is in the light-tailed 
phase, then are the corresponding nodes on the outer 
edge of the network, in the sense that, most of its con- 
nections are to the nodes outside its own class, or is it 



in the core of the network? Similarly almost all complex 
networks happen to have small diameters, meaning that 
there is a short path from any node to any other node. 
How many of those paths pass through a given class of 
nodes? 

We find that instead of nodes segregating into clusters 
of their own, they get embedded in the network in such a 
fashion so that nodes belonging to classes with light-tailed 
degree distributions are connected via a core comprising 
of nodes belonging to the heavy-tailed classes. This gives 
rise to global hierarchical networks, where the nodes can 
choose its position and functionality by controlling a set 
of well-defined parameters. For example, we define a pa- 
rameter called the capacity, which is the ratio of all edges 
with both end points in a particular class, and the total 
number of edges with any of its end points in the same 
class. Then as shown in Fig. [21 one can vary the relative 
capacities of the different classes by varying the differ- 
ent parameters. In general, the results show that when a 
class has high exponent, then it's capacity is low and as 
the exponent decreases the capacity increases. 

D. Implications: Discovering and Modeling 
Complex Dynamics 

An example of how the study of heterogeneous net- 
works may influence our understanding of mechanisms 
underlying a given network is given in Fig. U] It is well 
known that in a growing network the standard linear 
preferential attachment dynamic, where nodes joining a 
network makes connections to existing nodes with prob- 
ability proportional to their degrees, leads to a degree 
distribution with an exponent 7 = 3, which marks the 
boundary between a heavy-tailed and light-tailed distri- 
bution. The striking characteristics of heavy-tailed de- 
gree distributions are observed only for exponents < 3, 
and most documented networks display these scalings. 
In order to account for such widespread emergence of 
prominent scale-free structures, several alternate network 
dynamics andprotocols (e.g., doubly preferential attach- 
ment) HHIa SHU, which lead to a continuum of 
possible power-law exponents from 7 = 2 to 00, have 
been introduced. 



Does the presence of an exponent 7 < 3 mean that one 
of the alternate mechanisms is at work? As illustrated in 
Fig. d the presence of a heavy-tailed degree distribution 
need not necessarily imply that the simple linear prefer- 
ential attachment is not at play. Indeed, a PL degree 
distribution with exponent less than 3 can result from 
the standard linear preferential attachment dynamic if 
the network, for example, has two classes of nodes with 
varying acceptance or attachment rates. In this example, 
a node joining a network still makes globally preferential 
links, except that when the request reaches one of the 
classes, it rejects it with probability 1/2 while the other 
class always accepts a connection for request. From a 
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FIG. 1: An example of a grown heterogeneous network with multiple scale-free structures: The network comprises 
two classes of nodes, and nodes in both classes follow the same overall preferential dynamics: when joining the network, every 
node selects target nodes preferentially until a total of m preferential connections are made. The only deviation from the well- 
known preferential dynamics is that if a preferentially chosen node refuses a connection request, then the requesting node makes 
another independent preferential selection and repeats the process until a request is accepted. The dynamical rule differentiating 
the two classes is that while Type-1 nodes always accept all the connection requests (di = 1), Type-2 nodes randomly accept 
only half the requests (ab = 0.5). The two classes have equal representation, i.e., si = S2 — 0.5. As shown in the degree 
distribution plots, this dynamic leads to two distinct scaling features: A heavy-tailed degree distribution, 71 ~ 2.54, for Type-1 
(squares), and a light-tailed distribution, 72 ~ 3.54, for Type-2. Interestingly, the overall degree distribution (circles) closely 
resembles the degree distribution of Type-1 nodes, and hence, if the nodes are not differentiated then the whole network will be 
characterized by a single scaling parameter, 7 ~ 2.54. In general, single scaling parameter characterizations of heterogeneous 
networks will always hide the structure of all the classes of nodes, except that of the most heavy-tailed one: Consider the case 
of a network consisting of two classes of nodes, A and B, with PL exponents 7a and 7s, respectively. If 7a < 7s then the 
overall degree distribution is thus P(k) ~ k~ 1A + k~~' B ~ k~ 1A when k^> 1. 



mechanism perspective, if one did not view this as a het- 
erogeneous network, then one might be misled to infer 
that the underlying dynamic was something other than 
the standard preferential attachment. 

E. Implications: Designer Complex Networks 

In terms of explicitly designing heterogeneous dynamic 
networks, an example of great practical interest is the 
class of ad-hoc distributed systems, with peer-to-peer 
(P2P) content-sharing networks as a prime example. As 
discussed in more detail in Section IVII a P2P network 
has heterogeneous sets of nodes with varying lifetimes 
and bandwidth capabilities. A natural question is how 
to design local dynamics such that an overall scale-free 
structure will emerge, where each node category has a dis- 
tribution that suits its available resources and needs. We 
add an additional stringent design constraint: A node 
joining the network has no global knowledge of which 
nodes belong to which category, and it can only explore 
the network locally and only request connections to nodes 
that it can reach. The dynamics introduced in this paper 
provide a systematic solution to this challenging problem. 

The primary motivations for designing local dynamics 
so that a PL topology emerges include, (i) PL networks 
are resistant to random deletions and have vanishingly 
small percolation thresholds [Tl|: (ii) PL networks have 



a natural hierarchy allowing more capable processors to 
act as hubs; moreover, computing resources are hetero- 
geneous to begin with and PL networks provide a nat- 
ural set-up for the resource hierarchy to be embedded 
into a networking hierarchy, and (iii) the structure of PL 
networks can be exploited to provide scalable key- words 
based search capabilities jT^, Hfl |21| . While these prop- 
erties of PL networks, have been proven to be true for 
random PL networks, our recent results show that the 
grown random networks generated using the local dy- 
namics formulated in this paper (particularly, the ad hoc 
dynamics, where nodes randomly leave the network) lead 
to networks that are much closer to random PL graphs 
than those generated by previously-proposed algorithms 

[ii m. 

F. Prior Work 

Previously known dynamical models have mainly char- 
acterized the scale-free structure of the emergent net- 
works with a single state (manifested by the overall 
power-law exponent) . Nonuniform preference kernels and 
their effect on the overall power-law exponent of the 
emerging network has bee considered before in the con- 
text of fitness models. In (2^, a node dependent prefer- 
ential attachment kernel is introduced. As a new node i 
enters the network, it is assigned a fitness factor r\i ran- 
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domly drawn from some distribution. The probability of 
the node i receiving a new connection when its current 
degree is fc, will be proportional to rjiki. 

The argument is that different nodes in the network 
can have different inherent attractions. As such, a new 
node with a high fitness can gain more connections over 
time compared to an old node with a smaller fitness. This 
can explain, for instance, the high connectivity of some 
new pages in the WWW. The authors then derive the 
overall degree distribution as a function of the distribu- 
tion of the T]i 's. The same multiplicative fitness mode 
is adopted in [24[ for the case of directed preferentially 
grown graphs. In particular, it is shown that even a single 
node with a high fitness can acquire almost all the links in 
the network over time, corresponding to a condensation 
to a star-like topology. The work of [24j also considers the 
case of the mixture of two "weak" and "strong" classes 
which closely relates to the model considered in this pa- 
per when Q = 2 and c = 0. However, a detailed study of 
the emergence of different scale-free structures in hetero- 
geneous networks, and their dependencies on dynamical 
parameters have not been addressed prior to this work. 



G. Organization of the paper 

The rest of the paper is organized as follows. In Sec- 
tion [HJ we describe a dynamical model of the networks 
considered in this paper. We formally introduce the four 
parameters that can be used to characterize the different 
categories of nodes. In general, all four of these param- 
eters could be non-uniform over the classes of nodes in 
the network. However, for the sake of analysis and also 
understanding the roles of different dynamics in deter- 
mining emergence of scale-free structures, we study cases 
where only one or two of these parameters are nonuni- 
form over the nodes in the network, and the others are 
held uniform. For example, in Section HTTI we first analyze 
the model by considering the effects of only attractions 
and representations, as these parameters are varied for 
different classes of nodes. Moreover, we consider a dy- 
namic ad hoc network, where nodes both join and leave 
the network. Next in Section llVl we solve the model for 
the case of uniform attractions, but heterogeneous sta- 
bility, responsiveness, and representation properties. We 
are interested in explicitly tracking the structure of each 
subclass and investigating the fundamental constraints 
that the intra-class interactions of a particular class will 
impose on its emerging structure. To our particular in- 
terest is the coexistence of different phases in different 
classes. In Section we explicitly address this issue and 
look at the structure of the phase space, and phase tran- 
sitions that occur. In particular, we are interested in 
the heavy and light tailed degree distributions of sub- 
networks. Concluding remarks and applications of the 
dynamic rules investigated in this paper to the design of 
P2P networks are provided in Section IVll 



II. MODEL PARAMETERS 

A list of the parameters and variables used in this pa- 
per, along with their definitions, can be found in Table 
U Throughout this paper, q G {1, 2, Q} will represent 
the type or class or category (all three terms are used 
interchangeably) of a node in a network in which nodes 
can belong to one of Q different classes. 

The dynamics for network evolution considered in this 
paper can be summarized as follows: 

(i) Addition of Nodes: At each time step, a new node is 
introduced into the network, the new node can belong 
to any of the Q different classes or types indexed by an 
integer q = 1, 2, Q. The probability of the new node 
being of type q is assumed to be s q , where s q = 1. 

i 

(ii) Creation of Links: The new node, inserted at time 
step t, then makes m connections by picking nodes prefer- 
entially using the well known linear kernel. Target nodes, 
however, can refuse requests for connections, and hence, 
the new node performs the following procedure m times: 
It chooses a node preferentially; thus the probability of 

choosing a node i in the q th class is — — - - ' ^ — r where 

k(i,t;q) is the degree of the i th node in class q, at time 
step t (see Table DJ. The new node then sends a connec- 
tion request to this selected candidate. The candidate 
node i will accept the connection with probability d q de- 
pending on its type q. If the connection is refused then, 
the new node has to repeat the process until it finds a 
node that accepts a new connection. 

(iii) Deletion of Nodes: At each time step, for each class 
q = 1, 2, Q a randomly selected node of type q and all 
its links are deleted with probability c q . Thus, the total 
deletion rate is c = 5^2=1 c q < !■ 

(iv) Compensation for Lost Edges: If a node looses a link 
due to deletion of one of its neighbors, a node of type 
q will introduce n q new links following the same linear 
preferential procedure outlined above in step (ii). 

An important characteristic of this model is that it 
is local and private in the sense that only a node itself, 
and not the other members including the nodes trying to 
connect to it, has any knowledge about its type. 

The parameters s q ,d q ,c q , and n q thus represent the 
heterogeneity in the population, attraction/attachment, 
stability and responsiveness dynamics that characterize 
the different categories of nodes: 



A. Nonuniform Attraction (d q ) 

Different categories of nodes might have different de- 
grees of attraction (also known as fitness in that can 
influence the structure of all the classes. That is, a class 
of nodes might be more willing to accept the requests for 
new connections than the others. 
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B. Nonuniform Stability (c 9 ) 

The degree of stability of the nodes in different classes 
might be different. In an ad- hoc network, where nodes 
can join and leave the network, some classes of nodes 
might be inherently more stable than others. Those 
classes, by the virtue of the fact that they would stay 
longer periods of time in the network, will tend to ac- 
quire larger fractions of the connections and usually tend 
to become more heavy-tailed. The interaction of the 
classes of "older" nodes and the class of "fresh" nodes 
is fairly interesting. The phases of the subnetworks can 
be tracked separately for instance to determine the situa- 
tions in which the subnetwork of " old" nodes will acquire 
almost all the links of the network. 



C. Nonuniform Responsiveness (n q ) 

The degree of responsiveness of different sets of nodes 
to changes in the network might be different. We exam- 
ine the effects of heterogenous compensation magnitudes 
for the lost links. In a compensation mechanism as intro- 
duced in |T^ . a node will react to losing a neighbor by 
initiating a number of new connections to compensate for 
its lost links. The number of such compensatory connec- 
tions is an indication of the degree with which the node 
responds to its changes. We show that the different de- 
grees of responsiveness in different classes will influence 
the structure of other classes and the overall network. 



D. Nonuniform Population Size (s q and c q ) 

As stated in Table the number of nodes of type q 
at time t in the network is given by N(t; q) = (s q — c q )t. 
Hence, by varying s q and c q the proportions of different 
classes of nodes can be varied. In the special case of two 
classes one can define a majority and a minority class, 
and then study the effect of the relative populations of 
the different classes on the PL exponent of the degree 
distributions of each class. We derive in Sections IIIII and 
IIVI the role that sizes of the majority and minority classes 
play in determining the overall network structure. 



III. NONUNIFORM ATTRACTION AND 
POPULATION 

We consider the case where the different classes are 
characterized by different values of d q (acceptance prob- 
ability) and s q (population size). We assume that there 
is no compensation, i.e., ni = n% = ■ ■ ■ = nq = 0, and 
that the deletions of nodes are made uniformly over all 
the classes, i.e., c q = c* s q . Note that the homogeneous 
case, where there is only one class, i.e., \Q\ = I, was 
solved in [l^. Let i t - q be the set of all nodes of type q 
that are present in the network at time t. When a new 



link chooses a node i G it- q for connection, i can accept 
to attach to it with some probability d q and deny the at- 
tachment with probability 1 — d q . Once denied, the new 
link will have to repeat the process to choose another 
target node for connection. 

We first provide the following reduction: the protocol 
for selecting target nodes globally preferentially, until a 
node is found that accepts the connection, is equivalent 
to first selecting a class q with probability 5 q , and then 
making a connection to the i th node in the class with 
probability proportional to its degree as normalized with 
respect to the sum of the degrees of all nodes only in the 
q th class, i.e., the probability that the i th node in class 



q will receive an edge is 



S q k(i,t;q) 



where L[t\ q) is the 



L(t;q) 

sum of the degrees of nodes in class q (see TableQJ). In the 
equivalent protocol, the process of acceptance and denial 
is captured by the parameter, 5 q = f(d q ,s q ), which is 
the steady state probability of the new link being finally 
connected to a node of type q; the relationship among 
S qi d q ,s q is derived later in this section. The modified 
protocol is derived to make our analysis simpler. 

Next we prove the equivalence of the modified protocol 
(where the incoming node needs to select a class first, 
and hence, require global knowledge) to the original 
protocol (where the incoming node has no knowledge 
of the different class). Let (i)A q be the event that 
a node of type q is the end node of a successful link 
attempt; hence, p(A q ) = L jj^s = m q , (ii) C^ q be the 
event that a node i of type q is requested for a connec- 



tion. Then, p(a new link is established \Ci- q ) = d q , and 

P(Q; q ) 



— * jffis ■ Also, p(a new link is established ) = 

and we are interested in 

rule, 



p(Ci- q \a new link is made) 
get: 



are 

Using Bayes' 



we 



p(Ci- q \ a new link is made) 

p( a new link is established! Ci- q )p{Ci- q ) 
p( a new link is established ) 
d g k(i,t;q) 



L{t){Y!;=im P d p ) 
d q m q k(i,t;q) 

. k(i,t;q) 



(1) 



9 L(t;q) ■ 

The expressions for L(t; q) and m q are derived later in 
this section. 

The continuous rate equation approach [T^ . Il.'il | can 

now be employed to track k(i, t; q), at a time t > i in the 
equivalent protocol: 

dk(i,t;q) md q k(i,t;q) k(i,t;q) 



dt 



L(t; q) 



N{t) 



(2) 



where (i) the first term represents the fraction of new 
links that the i th node of type q gets due to the addition 
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TABLE I: Nomenclature 



Variable 


Definition 


Relation 


Q 

q e{i,2,...,Q} 

m 
s q 

c 
c q 
d q 

m q 

5 q 
L(t;q) 
Lit) 
k(i,t;q) 

D(i,t;q) 

7<7 


the number of different types of nodes 
denotes a particular class 
number of links per newly inserted node 
is the fraction of nodes of type q, per newly inserted 
the fraction of nodes deleted per an inserted node 
the fraction of nodes of type q deleted per an inserted node 
the probability that a node of type q accepts a request for connection. 

the probability of requesting a node of class q for connection 
the probability of a new link to be finally connected to a node of class q 

the sum of the degree of all nodes of type q k(i, t; q)). 
the sum of the degree of all nodes in the network (twice the number of all links) 
the degree of a node i of type q at time step t. 

the probability that a node of type q inserted at time i is still in the network at time t. 
the power-law exponent of the scale-free degree distribution in class q (p q (k) oc k~ K ). 


m g = L(t;q)/L{t) 

L p=l( m P d P) 

L{t) = J2 g L(t;q) 
D{i,t;q) = {\) 



of m new links at each step (see Eq. Q), and (ii) the 
second term represents the fraction of edges lost due to 
the deletion of a randomly picked node at each time step. 
Note that, in general N(t;q) — (s q — c q )t, and since in 
the case of uniform deletion c q — c * s q , we get N(t. q) — 
s q (l — c)t. Similarly, a rate equation for L(t;q) can be 
written as: 

dL(t;q) 
dt 

= m(8 q + s q ) - cL(t; q)/N(t) - c^^- ^ (3) 



L(t) N(t) 



m(5 q + s q ) - L(t;q) 



2c 



(l-c)t' 



where (i) the first term in Eq. © captures the follow- 
ing dynamic: A new node brings m links to the net- 
work. With probability s q this new node is of type q and 
with probability 5 q one of its ends will be connected to 
a node of type q; (ii) The second term in Eq. © cap- 
tures the following dynamic: When a node is deleted, 
it might be of type q with probability N(t; q)/N(t), 
and the class q will lose an average of L(t; q)/N(q,t) 
links, resulting in an average contribution to L(t] q) of 
-c(N(t; q)/N{t)) x L(t; q)/N(t; q) = -cL(t; q)/N(t); and 
(iii) the third term in Eq. corresponds to the links 
that nodes of class q lose due to their neighbors be- 
ing deleted: When a node is deleted, an average num- 
ber of L(t)/N(t) edges are deleted; now the fraction of 
these edges that are connected to nodes of type q is 
L(t;q)/L(t). 

L(t; q) is then found to be: 



1 - c 

L(t] q) = m(S q + s q)y^t ■ 

Inserting it back into (J2J) we get, 

dk(i,t;q) _ 6 q k(i,t; q)(l + c) k(i,t;q) 



dt (5 q + a q )(l-c) (1 

(8 q - csq)k(i,t; q) 
(8q + s,)(l - c)t ' 



c)t 



which implies k(i,t;q) = m(t/i)^ q , for: 

(3q=(5q-CS q )/[(l-c){5q + Sq)]. 

Next, using the relationship (7 — l)/3 = 1/(1 — c) devel- 
oped in |l2( we get 



1 



(gg + Sq) 
S q - CS q 



(5) 



At this point, we can make several observations about 
the coexistence of different phases for the different classes 
of nodes and the achievability of different exponents for 
the different classes by varying the attraction rates. 



A. Tuning exponents 7 9 's and attraction 
probabilities d q 's 

Recall that in Eq. Q we derived the following rela- 
tionship: 



6q = 



m q d q 



(6) 



where m q = L(t;q)/L(t). Note that L(t) = J2 q L (^l) 
— mt ( 1 — c) / ( 1 + c) , and hence using the result of Eq. 10} , 
we get m q = L(t; q)/ L(t) = {8 q + s q ), which gives: 



d q (5 q + s q ) 

Eg'(<V +S q ,)d q , 



(7) 



(4) Given d q ,s q , for q = 1,2, ...,Q, defines Q equations 
which can be solved for the Q unknowns S q . Thus, with- 
out loss of generality, we may assume that 5 q 's are known 
and unique for any given set of d q s and s g 's. Hence, we 
can uniquely find j q s, for a fixed set of d q 's, s g 's and c. 

Conversely, for a fixed set of 8 q 's and s q 's, the set of 
equations in is linear in d q (multiplying by the denu- 
merator of the right hand side) . Arbitrarily normalizing 
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dq's to define a new set of variables d' q — d q /di, d' q s can 
be found by solving the following linear system of Q — 1 
equations: 

Q 

E<^' + v)(^-W) = o 

for (7 = 2, 3, Q and setting = 1. The above system 
of equations is easily shown to be non-singular if and 
only if 8 q + s q > for all q — 1,2, ...,Q. In fact the 
determinant of the system of equations is easily shown to 
be n?=2(^<? + s i)- This shows the existence of attraction 
probabilities d q such that any set of power-law exponents 
as constrained by Eqs. Q) and |3J) can be achieved. 

B. Co-dependencies of the feasible PL exponents 
for different classes 

As discussed above, by sweeping over the parameters 
s 9 's and d q 's one can effect a continuum of power-law 
exponents 79 's, as determined by Eqs. (J5J and Q. The 
set of possible j q 's are however coupled through the re- 
quirement that J2 q $q = J2 q s q — 1- As an example, one 
can define two average quantities involving the power-law 
exponents: 

Q Q 

Enodeil) = X! S 9 7C ? aild E Hnk{l) = ^ (^9 + S 9)79 , 
9=1 9=1 

(8) 

where E no d e captures the fact that the averaging is taken 
over randomly chosen nodes (i.e., probability that the 
class of a randomly chosen node has exponent j q is s q ), 
and Eunk captures the fact that the averaging is done 
over random endpoints of a randomly chosen edge, i.e., 
the probability that a random endpoint of a randomly 
chosen edge belongs to the q th class is (S q + s q )/2. Now 
it follows from Eq. JSJ that 

Q 

Eunkiil-l)- 1 ) ^2- 1 (5,+ S ,)( 7 ,-l)- 1 = (l-c)/2 . 

9=1 

(9) 

For the special case of no deletion (c = 0) it follows from 
© that: 

Q 

Enodeil - 2)- 1 ) = Y,(l q - = 1 

9=1 

The convexity of the function f(x) — 1/x : 

Enodesiil - 2)- 1 } > {E node s{l} -2)^ = 1 

or E no des{l} > 3. In other words, on average the com- 
munities of the nodes have power-law exponents greater 
than 3. On the other hand, this also implies that even 
for the simple preferential attachment, heterogeneity can 
lead to an overall degree distribution with exponent < 3. 
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FIG. 2: Possible power-law exponents in a network with two 
classes of nodes. 71 is the power-law exponent of the degree 
distribution of the first class that consists of 80% of all nodes, 
while 72 correspond to the second class consisting of 20% of all 
nodes. The possible power-law exponents for three deletion 
rates c = 0, 0.2, 0.4. The asymptotes for c = and c = 0.2 
are also depicted. 



When Q = 2, the two exponents 71 (rfi, ^2), 72(^1, ^2) 
can be explicitly found as functions of d\ , di . By elimi- 
nating di , cfe, the set of possible power-law exponent pairs 
(7i 5 72) can be derived. An example of this is depicted in 
Fig. |21 for si = 0.8, s 2 = 0.2 for different values of c. To 
interpret the asymptotes, first note that from J^J, stable 
network operation is only possible when S q > cs q , oth- 
erwise the class q will become extinct (i.e., will loose all 
its links). Take class 1 for instance. Since 5 2 > cs 2 , then 
Si = 1 — 5 2 < I — CS2 = 1 — c + esi, which results in: 71 > 
l+(l-c+csi + si)/(l-es 2 -csi) = 2 + si(l+c)/(l-e). 
The same bound can be found for class 2 as well. Some 
of these asymptotes are also depicted in Fig. [21 



C. Role of deletion rate c 

It was shown in ^1 that when \Q\ = 1, i.e., there is 
only one class and the network is homogeneous, then 7 is 
always greater than 3 for any deletion rate c > 0. More- 
over, even for small values of c the exponent becomes 
quite large, and the network shows none of the charac- 
teristics associated with heavy-tailed PL degree distribu- 
tions. In the case of heterogeneous networks, however, 
one can have a class with a true heavy-tailed degree dis- 
tribution (as illustrated in Figs. |2Jand ), and the over- 
all network will thus exhibit a heavy-tailed distribution, 
even for non-zero deletion rate c. However, as c — > 1, 
we get (see Eqn. EJ: £9(^9 + s q ){ lq - l)" 1 = 0. Thus, 
in the limit of heavy node deletion, the degree distribu- 
tion of any class q with a finite size (s q > 0) becomes 
exponential (i.e., 79 — > 00 for all q = 1, Q). 

In the next section, a compensatory mechanism is ex- 
amined, which will result in classes with prescribed heavy 
or light tailed degree distributions, even in the limit of 
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very high deletion rates. Moreover, while the deletion 
process in this section was independent of the class of 
nodes (a node was randomly chosen for deletion), in prac- 
tice, different classes of nodes will have different stability 
characteristics. This important generalization is made in 
the following section. 



IV. HETEROGENOUS STABILITY AND 
RESPONSIVENESS 

Many ad-hoc networks are characterized by the fact 
that the time scale within which their size grows, is much 
larger than the time scale within which the nodes join and 
leave the network. In such networks (certainly including 
P2P file sharing systems) one has the case that c ~ 1. 
The scale free properties of growing networks that are 
subject to permanent deletion of their nodes are stud- 
ied in 0, 0] . In 0] , the heavy-tailed structure of the 
resulting scale-free networks were shown to immediately 
disappear in the presence of node deletion. Results in the 
previous section also showed that no heavy tailed struc- 
ture can exist in the limit of high deletion rates even in 
a heterogenous network. 

A universal compensatory protocol has been intro- 
duced by the authors in [l^, which ensures that the 
heavy tail of the degree distribution of the emerging net- 
work is conserved even in the limit of very high node 
departure rates. This section will investigate the behav- 
ior of different classes of a network of multiple types in 
the presence of (i) heterogenous node deletion or equiv- 
alently, heterogeneous stability factors, and (ii) hetero- 
geneous responsiveness, i.e., the rate at which different 
classes of nodes compensate for their lost or dead links is 
class dependent. A class dependent compensatory mech- 
anism is a generalization of the universal compensation 
scheme in pj| , and it plays a crucial role in restoring the 
heavy-tailed structure of some or all of the classes in the 
network. 

The dynamical model introduced in Section ^ allows 
for non-uniform deletion of nodes and compensation of 
links. For simplicity we would assume uniform attrac- 
tion, i.e., d\ = 0I2 = ... = dQ = 1, that is, all nodes accept 
all requests for connections. We let the other parameters 
s q ,n q ,c q be arbitrary. The goal is to characterize the 
emerging scale free state of each of the Q sub-networks 
as a function of these dynamical parameters. 



A. Rate Equation Formulation 

A mean-field rate of change of k(i, t; q) can be written 
as: 



dk(i,t;q) _ mk(i,t;q) ^ k(i,t;q) 
dt ~ L(t) C( Uq) N(t) 

k{i,t;q) /V L(t;q') \ ( ^ L(t;q") \ 
L(t) \2f n «' L{t) J yY'-Nfrq")) 

(10) 

where, (i) the first term comes from the contribution of 
the m new links inserted at time step t when L(t) is the 
sum of the degree of all nodes of type q (remember that 
we assume uniform preferential attachment), (ii) The 
second term captures the effect of the random deletion 
of one of the neighbors of i which is compensated with n q 
preferentially targeted new links (hence the 1 — n q mul- 
tiplier), (iii) The third term is due to the attraction of 
the compensatory links from other nodes rather than i. 

It assumes that an average of (j2 q i> c q" jy(t'g") ) l m k s are 
deleted, of which a fraction of ^fe^ belongs to a partic- 
ular class q' and will be compensated by n' q preferentially 
targeted new links. 

To find L(t;q), its rate of change can be tracked as 
below: 

dL(t;q) = 
dt 

L(t;q) / v L(t;q') \ 

where (i) the first terms corresponds to the new links 
added to the class q if the new node happens to be of type 
q (this occurs with probability s q ), (ii) the second terms 
is due to the end of new links being connected to a node 
of type q. (iii) The third term comes from the deletion 
of an average of L(t; q)/N(t; q) links if a node of type q 
is deleted, which is compensated by n q new links per lost 
link, (iv) The forth term is similar to the third term in 
ffTTfl . In the steady state one has L(t; q) « B q t, N(t; q) = 
(s q — c q )t, N(t) = (1 — c)t. The Q unknowns B q can thus 
be found through the following set of Q equations (one 
for each q = 1, 2, Q): 

B q = (I 
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Finding B q s and inserting back into (TDJl, k(i,t;q) is 
found to be: 

k(i,t;q) = m{t/if" (12) 
for (3 q a function of B q , c q , s g , n q 's as below: 



(3 q = ™ - C(1 ~ ^ + x V £ggg (13) 

S Sg - Cg £ ^ S 9 - C 9 



where B = J2 q Bq- 

Now define D(i,t;q) the probability that a node of 
type q, inserted at time i is still in the network at time 
t. D(i, t; q) can be found as follows: 



dD(i,t;g) 
dt 



-c q D(i,t;q)/N(t;q) 
-c q D(i,t;q)/[(s q - c q )t] 



resulting in, D(i,t;q) = (t/z)~ c s/( s 9 _c «). 

Finally, P q (k), the degree distribution of the nodes of 
type q can be found as follows: 



P q (k) 



No. of nodes of type q with degree = k 



Total number of nodes of type q 
N{t;q)D(i,t;q) 



1 



N(t;q) 



i:k(i,t:q) — k 



D(i,t; q) 



dk(i, t; q) 



di 



(14) 



i:k(i,t;q)—k 



Solving for i, such that k(i,t;q) = k from (|12fl . and 
inserting back into l|14|l we arrive at: 

P q (k) oc fc-^/K^-^)^]- 1 /^-! ^ fc -7, 
from which the power-law exponents are found to be: 
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FIG. 3: Different regions of the power-law exponents for an 
example consisting of two classes of nodes with si = 0.8, S2 = 
0.2, ci = 0.6, C2 = 0.15 for various compensation magnitudes 
< ni, 712 < 2. (i) The circles indicate the region in which 
class one is light tailed while class two is heavy tailed, (ii) 
Squares indicate the phase where both classes are heavy tailed 
(iii) both classes are light tailed where indicated by diamonds 
and (iv) asterixes indicate that the first class is heavy tailed 
while the second class is light tailed. 



l q = 1 



Pq{ s q Cg) 



(15) 



Finding the set of 7 9 's requires the tedious task of solv- 
ing the system of equations (fTT]) to find B q 's and then 
plugging the B q s back into l(T^|) to get the /3 g 's and fi- 
nally finding 7 9 's through H15JI . Such procedures are car- 
ried out for a number of examples in the next section. 



V. PHASE DIAGRAMS AND TOPOLOGICAL 
OBSERVATIONS 



A. Phase Diagrams 



FIG. 4: Phase diagram of a mixture of two classes of nodes. 
The entry rate of the two classes are the same si = S2 = 0.5. 
The axes correspond to 711,712. The curves represent the 
points in (711,712) for which either 71 = 3 or 72 = 3. The 
dashed curves are for the case of ci = C2 = 0.3 and are hence 
symmetric. As the deletion rates becomes un-balances, the 
phases curves also shift. The solid curves correspond to the 
deletion rates ci = 0.4, C2 = 0.3. It therefore takes more 
compensation for the first class to retain its heavy tail. Now 
the second class in its turn will acquire some of these excess 
compensations. Thus, overall the class two will need less com- 
pensation to stay heavy tailed. The net result is a shift of the 
phase diagram to the south-east. 



There are four particularly interesting emergent phases 
for a subclass of nodes of a network: 
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• The Light-Tailed phase, in which the network 
emerges into a quasi-equilibrium state in which the 
average degree of the nodes is bounded and non- 
zero, and the variance of the degree distribution is 
also bounded. 

• The Heavy- Tailed phase, corresponding to a sub- 
network with finite average degree but diverging 
variance of the degree distribution. Such networks 
possess many attractive properties (at least in their 
equilibrium form) like constant diameter or zero 
percolation probability • 

• Extinction phase, when the average degree of the 
subnetwork goes to zero and it looses most of its 
links. 

• Unstable or divergent phase, in which the average 
degree of the subnetwork diverges and the whole 
network loses its stability. 

Previous sections suggest the procedure for calculat- 
ing the emergent power-law exponent of all the network 
classes as a function of the model parameter, n q ,c q ,s q . 
This in turn can determine the state of all subnetworks 
of the network. An example of such procedure is car- 
ried out for two classes of nodes with si = 0.8, s 2 = 
0.2, ci = 0.6, C2 = 0.15 for various compensation magni- 
tudes < ni,ri2 < 2. Only the heavy-tailed and light- 
tailed phases are marked and thus there are a total of 4 
possible phases for the whole network depicted in Fig. 

The contour in the space of parameters for which 
jq = 3 is important because it marks the transition of 
the phase of the network from a stable light-tailed state 
into a stable heavy-tailed one. An example is depicted 
in Fig. in the scope of parameters ni,n 2 for fixed 
Ci, c 2 , Si, s 2 . 

To our special practical interest is the case of quasi- 
uniscale networks, the networks in which most of the 
nodes belong to a single category and most deletions and 
insertions happen in the nodes of this category. Call this 
category, q — 1. We then define a quasi-uniscale network 
as one in which c\ w c ^> c q , s± ~ 1 3> s q ,s\ — c\ 
s q -c q ,q^ 1. 

Class 1 will be called the majority class and the rest 
of the classes are called minority classes. It then follows 
that L(t, 1) w L(t) and L(t; q) < L{t) for all q ^ 1 which 
reduces (JTTJ) to: L(U q) w 8 q ^2m(l - c)t/(l + c - 2«ic), 
where 8 q . q i is the Kronchker's delta function. Inserting 
in (| 1 31) . the /3 q 's are found to be: 



from which: 



(1 — c + 2c(n q — m + ni5 q ,i)) 



71 « 1 + 
7, ~ 1 + 



1 — c + 2cni 
2r„ 



c 1.5 




FIG. 5: Different phase regions in the space of parameters 
(711,712), where rii is the compensation rate for the majority 
class while ri2 is the corresponding parameter for the minority 
class. The phases are as follows: (A) The majority is light- 
tailed while the minority is heavy-tailed. (B) Both the major- 
ity and minority are light-tailed (C) Both are heavy-tailed (D) 
Minority is light-tailed while majority is heavy-tailed (E) The 
minority extinction (F) Majority becomes unstable (infinite 
mean) (G) Minority becomes unstable (infinite mean) 



where 



called the robustness factor of the 



1 — c + 2c(n q - m) ' 



'1 ~ s,(X-c)> 

class q is the fraction of nodes of type q that are in the 
network over the fraction of nodes that enter per newly 
inserted node. In the limit of very active quasi-uniscale 
networks (c — > 1), one gets : 71 ~ 1 + 1/m while 7 9 ~ 

An example of the phases for this limiting case is de- 
picted in Fig. |SJ 

Another interesting limit is where only one class com- 
pensates for its lost links and the rest of the classes are ir- 
responsive. Consider the case of a mixture of two classes 
where the first class with C\ = 0.8, si — 0.75 does not 
compensate (ni = 0). The phases regions of the second 
class with s 2 = 0.25 are depicted in Fig. EJas a function 
of its deletion and compensation rates (c 2 , n 2 ). 



B. Simulations 

For a network of finite size, the variance of the degree 
distribution is an indication of how heavy-tailed the de- 
gree distribution is. Plotting the ratio of the variances 
at different classes in the space of dynamical parameters 
will allow us to compare the relative state of different 
network classes. We have simulated a network of 5000 
nodes with two categories of nodes ,Q — 2, with uniform 
deletion of magnitude c = 0.5 and s± = s 2 = 0.5 for 
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FIG. 6: Stable heavy-tailed minority class: The majority class 
with si = 0.75, ci = 0.8 is not compensating (ni = 0). The 
region in the space of the n,2 , C2 where the minority class is 
stable and heavy tailed (i.e., 2 < 71 < 3) is highlighted. The 
part to the left of the region (for higher compensation rates) 
indicates 71 < 2 while the region to the rights indicates 71 > 
3. 



FIG. 7: The ratio of the variances of two classes with c = 0.5, 
si — S2 — 0.5 as a function of the compensation magnitudes 
ni , n.2 ■ The variance of the degree distribution increases as the 
compensation magnitude of the corresponding class increases. 



various compensation magnitudes m,ri2. We have then 
plotted the ratio of the variances at each of the classes 
for each value of (ni, 712) in Fig. [7| 

Simulations to obtain power-law exponents for two 
classes with equal insertion rates and various deletion 
rates are depicted in Fig. [5] and verified against the an- 
alytical expectations. 



C. Topological Observations 

As suggested in the introduction, the class of nodes 
that are more heavy tailed are expected to play more 
central roles in the topology of the network. The light 
tailed classes on the other hand would be pushed to the 
edges of the network serving as leaf nodes. This is a very 
desirable property for many application including P2P 
communication systems as discussed in more details in 
the following section. In this section we try to quantify 
the place of a category of nodes in the network. 

The quantity we consider is the so called capacity of 
each subnetwork. For a node category q, the capacity 
C q is defined as the total number of edges that have both 
their ends in a node of type q, over twice the total degree 
of all the nodes of type q. When C q — 0, the category q 
has all its edges to the outside of the category q. On the 
other hand C q = 1 , all the links of the nodes in category 
q stay within the same category. One can thus assume 
that a network with small capacity has a leaf role, while 




FIG. 8: The power-law exponent of a network of two classes 
with 10000 nodes. The insertion rates are si = S2 — 0.5 and 
the overall deletion rate is a constant c = 0.5. The deletion 
rate of the two classes are however different. For various ratios 
of the deletion rates, the power-law exponent of these two 
classes are found through simulation. Also depicted are the 
theoretical predictions of the previous section. 



a large capacity is an indication of a more compact topo- 
logical structure. Fig. depicts the capacities of the two 
categories of a network of two categories as a function 
of the relative rate of deletion c\jc%. The more stable 
subnetwork will have a larger capacity, which decreases 
as ci/c 2 — » 1. 
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FIG. 9: The ratio of the capacities of the two node categories. 
The network size is 10000, Si = s 2 = 1/2 and c = 1/2. The 
ratio of the deletion rates for the two categories are varied 
from 0.3 to 1. The dashed line marks the transition of the first 
category from a divergent phase into the phase with power- 
law exponent greater than 2. 



VI. CONCLUDING REMARKS: 
APPLICATIONS TO P2P NETWORKS 

An important example of a complex, highly dynamic, 
and heterogeneous network (which also partially moti- 
vated this research) is the less structured or ad-hoc dis- 
tributed systems with peer-to-peer (P2P) content shar- 
ing networks as a prime example. While nodes in a P2P 
computer network have heterogeneous resources and life- 
times, they can be classified into a few meaningful classes 
based on hardware or software characteristics. In partic- 
ular, the nodes can be categorized into two major classes 
|10| : (i) Super- nodes with virtually infinite bandwidth 
(e.g. office users) that run a super-node software and 
(ii) the low bandwidth home users that run the ordi- 
nary software. The fraction of super-nodes is extremely 
small (around 1% of the whole nodes) but super-nodes 
are much more stable, with their life times ranging any- 
where between 10 to 100 times of the home users. 

The integrity of such P2P networks requires most com- 
munication paths to be provided by the super-nodes; oth- 
erwise, the traffic at the home users will soon exceed their 
limits and the network structure will be fragmented. This 
can be ensured only when the network core, that is the 
highly connected nodes in the network, are mostly super- 
nodes (or nodes with more capabilities). An ignorance 
of this fact has led to the apparent break down of the 
Gnutella network, an early P2P file sharing system in 
2000 [26|. 

The dynamics of P2P networks is dominated by the 
rapid rate of the members joining and leaving the net- 
work. More than 60% of all the nodes joining these 
networks will leave within the first hour, while it takes 



around three months for the overall size of the network 
to grow by 60% [2(j . Ensuring the emergence of a heavy 
tailed scale-free state in such ad-hoc environments is a 
challenging task. As was shown in Section llVl the same 
compensatory mechanism developed in [l2| can ensure 
the emergence of scale-free structures with heavy tails 
among more stable groups, the groups anticipated to be 
composed of nodes with high capacity, while the major- 
ity of the nodes will have a light tailed degree distribu- 
tion and are therefore exempted from the search paths. 
The results of this paper will serve as an essential part 
of ad-hoc network formation protocols that can support 
efficient search robustness, and allow highly 

dynamic operations. 

In passive networks, in which the connections of a new 
node are never redirected or modified once they are es- 
tablished, the dynamical parameters (s q ,n q ,d q ,c q ) are 
usually fixed constants. On the other hand, in most ac- 
tive networks (e.g; P2P applications), some or all of these 
parameters can be locally manipulated by the nodes. 
The manipulations of these parameters can be considered 
as active network design protocols that can modify 
these parameters and thus can engineer the power-law 
exponents j q . Consider first the possibility of simulated 
deletion of the nodes of a network. There are classes of 
networks (e.g. P2P computer networks) in which a node 
can simulate its departure (log-off) through a software 
decision. In such networks, the stability of a class of 
nodes can be manipulated as follows: At each time step, 
for any q, with probability l qi a randomly chosen node of 
type q decides to leave the network (and hence discon- 
nects all its links) and quickly joins back (with m pref- 
erentially targeted links). This would then modify the 
model parameters as follows: s q — > (s q + l q )/(J2 q ' 
c q — > (c q + l q )/(l + J2 q , l q ). Also, the compensation mag- 
nitude n q of any class can be manipulated through the 
"software" running on that node. By varying n q , the 
class q can tune its emergent power-law exponent j q . 

Figure H10[) is an example of how the simulated log-off 
can tune the heavy tailed structure of a class. 

In conclusion, the structure of preferentially grown net- 
works with heterogeneous preference kernels has tradi- 
tionally been categorized with a single parameter, namely 
the power-law exponent of the overall scale-free de- 
gree distribution of the network, if such scale-free state 
emerges. We introduced a number of local rules that can 
tune the emergent scale- free states of different classes and 
in particular can ensure heavy or light tailed distributions 
within a particular class. These protocols dealt with four 
major dynamical elements of the network: The linkage 
properties of the network; The rate of departure of the 
nodes in the network; the rate with which nodes of a cer- 
tain class q compensate for the links they lose; and the 
rate at which nodes accept requests for connections or 
links. Different phases of the emergent subclasses under 
these local rules were characterized and the boundaries 
of phase transitions were identified. 
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FIG. 10: Manipulating Network Structure By Altering 
Local Rules: The change in the variance of the degree dis- 
tribution in a network consisting of a majority class ( 90% of 
the nodes) and a minority class. The network has size 10,000 
and both classes compensate with rate n = 1. At the point 
indicated by "uniform deletion", a uniform deletion with rate 
c = 0.5 is in place. The path shows the change in the variance 
of the degree distribution as the majority starts to simulate 
a log-off. Without any simulated log-off, the variance in both 
classes are high, but as the simulated log-off rate increases, 
the variance of the majority quickly decreases, while the mi- 
nority remains heavy tailed. 
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